About us

MapUp is a Silicon Valley tech pioneer revolutionizing the way modern fleets manage tolls billing and payments through its AI-based, software-defined tolling solutions. Operating in over 90 countries across North America, Europe, Asia, Australia, and Latin America, MapUp empowers fleets with accurate toll billing and toll spend insights, leading to reduced billing cycles, improved driver satisfaction, and significant cost savings. At the heart of MapUp's innovative solutions are its flagship products, includingTollGuru® for pre-trip toll intelligence and optimization, TollTally™ for GPS-based near-real-time toll billing, and TollMatch™ for efficient post-trip toll reconciliation and auditing. Learn more about MapUp and its solutions here.

Job description

We are seeking a Senior Data Engineer to lead and optimize scalable data pipelines, ETL processes, and big data frameworks using AWS (S3, Glue, Lambda, Spark). You'll manage data warehousing on Redshift, automate workflows, and improve performance monitoring. Proficiency in SQL, Python, and AWS is essential. Familiarity with Kafka and DBT is a plus.

Responsibilities

• Data Pipeline Development: Design, build, and optimize scalable data pipelines using Python, SQL, and AWS services such as S3, Glue, EC2, and Lambda to process large datasets.
• ETL Processes: Develop and maintain ETL workflows using AWS Glue and Athena, ensuring efficient data extraction, transformation, and loading from various sources to Redshift and other storage solutions.
• Big Data Processing: Implement and manage distributed data processing frameworks using Apache Spark on AWS EMR for large-scale data transformations and analysis.
• Cloud Automation: Automate and orchestrate data workflows using AWS services like Batch, Lambda, and CloudWatch to ensure high availability and cost-effective data processing solutions.
• Data Monitoring & Optimization: Set up performance monitoring, logging, and alerting systems using AWS CloudWatch and optimize data processing workflows for improved efficiency and cost-effectiveness.
• Data Warehouse Management: Manage and optimize data warehousing solutions on Redshift, ensuring proper schema design, query optimization, and seamless data access for business users.
• Collaboration with Data Teams: Work closely with data analysts and data scientists to understand data requirements and provide efficient and scalable solutions for their data needs.
• Documentation & Best Practices: Maintain thorough documentation of data processes and follow best practices for code quality, security, and compliance within AWS environments.
• Real-Time Data Streaming: If experienced with Kafka, implement and manage real-time data streaming solutions for real-time analytics and data integration.
• Data Transformation with DBT: Utilize DBT for transforming and managing data models in the data warehouse, ensuring consistency and accuracy in the transformed data.

Experience and Skills

• Work experience: 2+ years of relevant experience.
• Education: B.Tech, BCA, B.Sc(Computers and Stats), M.Tech, MCA.
• Must have: SQL, Python, AWS (S3, EC2, Glue, Athena, Batch, EMR, Redshift, Cloudwatch, Lambda), Spark
• Good to have: Kafka, DBT.
• Experience with real-world data applications, debugging, and scaling solutions.
• Ability to lead projects, train fellow team members, and introduce new techniques.
• Demonstrated problem-solving skills with a focus on efficiency.

Good to have

• Experience with productionizing algorithms for real-time systems
• Deep understanding of Bayesian modeling

Benefits

Team

You will be joining a team of mapping experts who care deeply about their customers. We are transforming mapping into a practical decision-making tool for commuters, commercial transporters and mobility providers.

Following Are Some Of The Perks

We are a “work family”, a highly collaborative, supportive, skilled, thoughtful, and intellectually curious group of people who are focused on making MapUp a great place to work! Following are some of the perks:

• Full-time, remote position.
• Competitive salary.
• Collaborative and supportive team environment.
• Flexible work schedule to promote work-life balance.
• Company-sponsored work trips.
• Opportunities for professional growth and career advancement.